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INTRODUCTION 



Numerous questions have been raised about the sex fairness of vocational 
interest inventories (e.g., Diamond, 1975; Tittle £> Zytowski, 1978). As a con 
sequence, the National Institute of Education (Diamond, 1975) developed guide- 
lines for evaluating the sex bias/fairness of career interest inventories. 
Also, In response to this concern, modifications have been made to existing 
vocational interf^st inventories (Campbell, 1974), and new ones have been devel 
oped (Prediger & Noeth, 1979). 

One promising develot^ment has been the finding that the occupational card 
sort technique seems to broaden the career options of women. Two recent stud- 
ies are of particular interest. Cooper (1976) compared the effects of the 
Strong-Campbell Interest Inventory (SCII; Campbell, 1974) with the Non-Sexist 
Vocational Card Sort (NSVCS; Dewey, 1974) for undecided college females and 
found thac the VCS was more effective than the SCII in broadening career op- 
tions (i.e., more nontraditional occupations were listed). In a later study. 
iqTih^/i! vrf'^P"^'^ 'H' ^^'^ Self-Directed Search (SDS; Holland, 
tions^;h:n%he SDs! '° ^ significantly, broader range of occupa- 

The present study was designed to assess the impact of a recently devel- 
oped occupational card sort, the Occu-Sort (0-S; Jones, 1977a. 1977b) on the 
thoughts and activities of junior/senior high school students from rural sub- 
urban, and urban communities. Of particular interest was the proportion *of 
nontraditional occupations suggested to students by the 0-S, as well as the 
proportion of nontraditional occupations in which they later indicated an in- 
terest. The 0-S was designed to avoid sex bias (Jones, in press-b) . The same 
set of cards was used by both sexes, and the neuter forms of occupational 
titles were used. In selecting the occupations to be included in the 0-S 
those having strong sex role associations were avoided. Thus, it was predicted 
perience ^"^^ options would be broadened by being exposed to this ex- 

In addition to investigating the above sex bias/fairness issue, several 
other important issues were investigated. The effect of the 0-S on lunior and 
senior high school students was studied in the following areas: (a) under- 
standing and recall of the three-letter occupational code obtained from the 
0-S. (b number of occupations suggested by the 0-S atid being considered later 
variPtv nf^ff"" "'l^ vocational counseling experience, (d) frequency and' 

ra^itv'n? after the experience, (e) satisfaction and cer- 

tainty of vocational plans, (f) specificity of criteria for making a vocational 
choice, (g) need for knowledge about oneself, and (h) need for educational and 
occupat iona information. In addition, the validity and reliability of 
occupational code were investigated. eiiaoiiity ot the 

rhp J^^^ P'^J"^^?^^ feature of the Occu-Sort system is a set of 60 cards On 
on«l L name of an occupation, its three-letter ciccupa- 

development (OED) level according to the Dictionary of Occupational Titles (DOT) 
(U.S. Department of Labor. 1966); on the back is a description of the occupa^on 
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as found in the DOT, Following the procedures originally outlined by Tyler 
(1961), users sort the cards into rh ^ piles: Would Not Choose, Might Choose, 
and Uncertain, The cards in the WoUi... Not Choose pile are then re-sorted into 
smaller piles according to the person's reasons for rejecting them (e,g,, 
•'They require that I travel a great deal," or "These would be boring"). Simi- 
larly, the Might Choose cards are sorted into smaller piles according to rea- 
sons for their being appropriate (e.g., "They require working with people and 
I enjoy that") • The Might Choose occupations are then rank-ordered according 
to the person's preference for entering them. These four steps stimulate indi- 
viduals to think about and articulate their motivations and values In making a 
career choice* 

In the final step a personal three-letter code based on Holland's (1973) 
six personality types--Realistic (R) , Investigative (I), Artistic (A), Social 
(S), Enterprising (E) , and Conventional (C) --is calculated. Using this code 
the individual is guided to occupations which are similar to those placed in 
the Might Choose pile. In the present study the 0-S Self -Guided Booklet 
(Jones, 1979) was used. With this version of the 0-S, students are self -guided 
through the sorting steps and the calculation of the occupational code, and 
then they are shown more than 500 occupations organized according to the six 
Holland types: R, I, A, S, E, and C. In this way an Individual's occupa- 
tional horizons may be widened* 

The design, procedures, and questionnaires of this study are similar to 
those used in a previous study (Zener & Schneulle, 1972, 1976) where the 
effects on high school students of the Self -Directed Search (SDS; Holland, 
1970b) --a self -administered , vocational counseling experience--were studied. 
Many of the same effects were of interest in evaluating the 0-S, Since the 
present study included the SDS in its design, this study largely replicated 
the Zener and Schneulle study. Of the several differences, the presient study 
included junior high school students in addition to those in senior high 
school. This study also included students from rural, suburban, and urbap set- 
tings. 

The following criteria were selected to evaluate the 0-S: 

1, The student will indicate more interest in nontradit ional occupations 
for his or her sex on the 0-S booklet, immediately after having taken 
the 0-S and three weeks later, 

2, The student will be able to recall his or her three-letter code, in- 
terpret it, and demonstrate an understanding of it immediately after 
having completed the 0-S and three weeks later. 

3, The student will consider more occupations on the 0-S booklet, immedi- 
ately after having taken the 0-S and three weeks later, 

4, The student will be satisfied with this vocational counseling experi- 
ence . 

5, The student will engage in increased vocational information seeking 
behavior. 
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6. The student will be more certain and satisfied with his or her voca- 
tional plans. 

7. The student will spend more time thinking about his or her occupa- 
tional future. 

8. The student will be able to specify more criteria that are important 
to him or her in making a vocational choice. 

9. The student will have less need for having information about himself 
or herself before beginning to make a vocational choice. 

10. The student will be more interested in finding out specific informa- 
tion about Jobs and training programs. 



To test the effects of the 0-S, it was compared to the SDS and a "no- 
treatment group. The students who took the 0-S were expected to be superior 
on the above criteria when compared with the SDS and control groups. Since 
the control group received no other treatment than that ordinarily provided by 
the school or the students' families, this seemed to be a realistic prediction. 

The SOS is a well known, self -administered vocational counseling simula- 
, tion. In using the SDS, students evaluate their occupational daydreams, acti- 
. vities, competencies, abilities, and vocational interests; from this they cal- 
culate a three-letter occupational code. They then use the code to find other 
■ yoi^''^ °""P^^^°"S ^ booklet called the Occupations Finder (OF; Holland, 
j 1970a;. The OF contains about 500 occupations organized according to three- 
, letter codes. For example, those persons having a code of RIE look in the RIE 
.section to find other occupations having this code. They then generate the 

'5^!!?;??^ °^ 1°°^ those sections for 

additional occupations. 

The 0-S was expected to be more effective than the SDS for the followine 
reasons: (a) occupations of interest are directly chosen from the cards, the 
collection of occupations listed in the self-guided booklet is more open to 
examination, and several steps were taken to weaken the influence of sex 
stereotypes in the occupations (discussed earlier); (b) the O^S self-guided 
booklet gives a brief description of Holland's theory and a brief definition 
Mf!!f f!'' occupational types; (c) additional occupations may be iden- 

tified more easily, as the pei-mutations of the three-letter code do not have 
to be calculated and the headings and subheadings of the occupational group- 
ings have intormative, descriptive labels; (d) specific instructions are given 

tlons '° ''"''"^ ^"'^ information about specific occipa 

tions (e) the psychomotor activity required in the soming of the cards is 
qualitative y different and appears to be more absorbing than completing a 
the'o'sT'i ^"'//'^ equivalent of the SDS's Op'is contained within 
the 0-S booklet and is taken with the student, whereas the OF is viewed as 

st2n,T .1 r'.'' '"r^' '''' ^^"^^"^ finished; and (g) he 

ions i : 'Z r'T -^fy articulate his or her' vocational motiva- 

tions (i.e., Vhat is and is not important to me about these occupations^") 
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In addition to ..lese a priori comparisons (0-S vs. SDS; 0-S vs. control), 
several other "independent'' variables were of interest (a posteriori compari- 
sons) , These included the effects of sex, race, socioeconomic status, school 
level (junior/senior high school), setting (rural, suburban, urban), and the 
effect of having the students complete the study's questionnaires. 

Also of interest were the psychometric characteristics of the 0-S occupa- 
tional code. Test-retest reliability of the occupational code over a three- 
week period was examined. The concurrent validity of the code was tested by 
comparing it with the code derived from the Vocational Preference Inventory 
(VPI; Holland, 1965), the definitive measure of the six occupational typeR. 
The 0-S raw scores were intercorrelated to see if the hexagonal relationship 
predicted by Holland's (1973) theory emerged. To further examine this analy- 
sis of the 0-S's construct. validity , the VPI scores were also intercorrelated 
to compare with those of the 0-S to see how they both fit the hexagon. Fin- 
ally, the extent to which students made errors in calculating their code was 
studied. 
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The participants in this study were students from four Junior high schools 
and three senior high schools in the Wake County (North Carolina) school sys- 
tem including Raleigh and the surrounding area. Eighth-grade students from 
the Junior highs and primarily tenth-grade students from the senior highs par- 
cicipated The attendance patterns of the school system were studied so as to 
lllll ^""^t "^^""^ "^"^^Pts predominantly rural, suburban, or urban 

til f Jit ^^^^^^^'^^y- was necessary to use four Junior high schools since it 
was teit that no one Junior high school could adequately represent the Raleiah 

L "'^^^^ ^^8^ selected and the re ulfs 

rltirlt n'"* eighth-graders were in a vocational exploration class 

In^ir^ L ftudents. and the high school students were from a required 
social studies class. Socioeconomic status was determined from parent's occu- 
pation using Duncan's (1961) Socioeconomic Index of Detailed OccupaUons "e- 

Itu'ien r rTn'r f ^^^'^^"^^ questLni"r;s the 

students completed during r.he study, is presented in Table 1. Data for the 

dUfici?t ?nr^^hL'^'''*''''^^°''* ^"'^ ^"'^"'^ treatments were too 

difficult for them to complete. See Appendix A for a detailed explanation. 

Experimental Treatments 

aT^' °^ «^;)e day prior to using the O-S , the Junior high school students 
tf inor"^:^ niotivations, (b) were given the opportunity 

lo lZ Z briefly, and (c> were given preliminary instructions as"^ 

to how the cards would be used. The following two days they used the Plus 3 
Level set of cards and the second edition of the Self-Guided Booklet (1979) 
The lesson plan for the "orientation class" is con:ained in Appendix B. An 
orientation was considered unnecessary for the high school students; they were 
given two days (two consecutive classes) to complete the O-S. 

n— * ""^^^ previous group, the Junior high school students were 
given an orientation to the following day's task (see Appendix C). They dis- 
cussed their personal work motivations and other related topics, briefly ex! 
?h "fnn^^'°^'°°!;''''^^"' ^^^^ preliminary instructions'for 'their ise 
Iln^ K ^l;' 1!^ '^^^ ''^'^^^^ *^^""8h the SDS, Form E (for easy) assess- 

ment booklet, scoring their responses and determining their summary occup" 

their 'hh ^^entify occupations corresponding to 

their code and its permutations . The high school students were Riven two H^v« 
to complete the standard SDS assessment booklet and the OF. ^ 

No-Treatment . Classroom instruction and activities for studpnfs in -k^ 
group were unchanged from what they were normally students in this 

Instruments 

CO the "gener.! educational development (GEor^/the'c'^c^^atlo': ZlllrJ"' 
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Table 1 
Student Characteristics 



Group 


n 


7 

/o 


Sex 




Race 


7o 


in 1/3, 


SES 




7. 


in Grade 






Girls 


White 


Black 


Lower 


Middle 


Upper 


8 


9 


10 


11 


12 


lunior High School 




























Rural 


(See 


text 


and Appendix A for explanation of missing data) 












Suburban 


107 


53 


47 


85 


15 


23 


43 


34 


100 


- 


- 


- 


- 


Urban 


83 


45 


55 


63 


36 


46 


23 


31 


100 










senior High School 




























Rural 


123 


45 


55 


76 


24 


53 


33 


14 




4 


46 


32 


18 


Suburban 


139 


45 


55 


77 


23 


27 


34 


39 






94 


3 


3 


Urban 


125 


56 


44 


76 


24 


26 


35 


39 






82 


13 


5 


iotals 


578 


49 


51 


82 


18 


32 


33 


35 


33 


1 


50 


10 


6 
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within a set. The GKD, counselors will recall, refers to the formal and in- 
formal aspects of education that contribute to ».ne worker's "(a) reasoning de- 
velopment and ability to follow instructions, 4nd (b) acquisition of 'tool' 
knowledges, such as language and mathematical skills" (USDL, 1966, p. A-5; 
these ratings are contained in the DOT). The Plus 3 Swt of cards, then, con- 
tains occupations having GED levels of 3, 4, 5, and 6--those requiring some- 
what less than a high school education through those requiring a college de^ 
gree. The education required for the occupations included In this set closely 
resembles the years of school completed by persons 25 to 29 years of age 
(USDC, 1977). Thus, the Plus 3 set Is especially appropriate for groupe of 
high school students In which there Is a broad cross-section of vocational 
aspirations . 



Vocational Preference Inventory (VPI) . The VPI Is a personality Inven- 
tory developed by Holland (1965), composed entirely of occupational titles. 
The person taking It Indicates the occupations he or she likes. The results, 
among other things, show the test-taker's resemblance to one or more of Hol- 
land's six personality types: R, I, A, S, E, and C. 

Student O pinion Form (SOF) . The SOF was originally used by Zener and 
SchneuUe (1972) to assess satisfaction with the SDS and was ip.ter revised by 
Cooper (1976) so as to be applicable to career exploration experiences In gen- 
eral. In this version, three items were added to the scale. Part I consisted 
of 12 statements to which students responded on a 5-polnt scale, from "Strongly 
Agree" to "Strongly Disagree." (The four questionnaires used in the study are 
duplicated in Appendixes D-G.) Part II assessed students' ability to recall 
and Interpret their 0-S or SDS occupational code. 

Vocational Guidance Questionnaire 1 (VG Qlj . The Items for the VGQl were 
taken from a questionnaire used by Zener and Schneulle (1972). The^flrst 
three items ask for descriptive Information about the student. Item 4 asks 
the sLudents what occupations they are considering at that time. Item 5 
fssesses the students' understanding of Holland's notion of matching occupa- 
tions with personalities. Items 60, D, E, and F assess the students' need for 
occupational and job training Information; 6A, G, H, I, and J assess the sat- 
isfaction and certainty of students' vocational plans. The mean response rate 
for these two proups of items was used in the analysis (items G and A were 
reverse scored). Item 6B assesses the extent to which students need more in- 
formation about themselves before progressing further in making a vocational 
choice . 



VocaUonal Guidance Questionnaire 2 (VGq 2) . The frequency of nine dif- 
teront tvpos of vocational exploration behavior was assesses in Part I by what 
has become known as the "Vocational Exploration Behavior Checklist," origin- 
ally developed by Krumboltz and Schroeder (1965) and slightly modified by 
Zener and Schneulle (1972). Variety of infonnation seeking was assessed by 
using the mean "yes-no" responses to the items, and frequency of information 
seeking was determined from the mean number of times, students indicated they 
had done the action described by each ite-n over the previous three-week period 
lto:n 2 ot r.he V(;q2 asks students, again, what occupations they are considering 
at that time. Item 3 assesses the time students have devoted to thinking 
about their occupational future over th« previous three-week period, item 4 
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assesses the students' understanding of Holland's tl»eory. The questions in 
Part II assess students' ability to recall and interpret their 0-S/SDS occupa * 
tional code . 

Vocational Guidance Qu e stionnaire 3 (VGQ3) > The first three Items request 
information about the students" sex, age, and other characteristics of inter- 
est. Item 4, as \n item S of the VGQl, asks students to match occupations 
with the Holland types to assess their understanding of the concept. Items 5 
and 6 were intended to assess vocational decidedness and comfort, but were dis«- 
carded because frequent student questions about their wording raised doubts 
about their validity and reliability. Item 7 was designed to assess students' 
specificity with respect to identifying their work motivations (i.e., what w^s 
important to them in selecting an occupation) • 

Table 2 relates the questionnaire items to the criteria investigated in 
the study. 

Indexes 

Index of similarity . In order to compare the similarity between three- 
letter codes of the instruments used (e.g., 0-S vs. VPI) , a numerical index 
was needed. The seven-point index recommended by Holland (1972) and used by 
Zener and SchneuUe (1972) was adopted. The scores range from 0 to 6; Table 
3 shows the probability of obtaining various combinations by chance. 

Extent of errors in calculating code . The following numbers were used to 
indicate the extent of errors in calculating the occupational code: 1 = an 
error in computation, but no change in the code; 2 « ian error which caused a 
reordering of the letters of the code; and 3 = an error where the person's 
code contained one or more wrong letters. 

Proportion of nont radltional occupations . At the time of this study, the 
most current statistics showing the proportions of males and females engaged 
in various occupations were for 1977 (USDC, 1978). At that time women consti- 
tuted 40,5 percent of the labor force. Thus, nontraditional occupations for 
women were defined as any occupation in which less than 40.5 percent of the 
labor force was female. Any occupations where females represented greater 
than 59.5 percent of those engaged in it were defined as nontraditional occu- 
pations for males. 

Procedure 

With the aid of school guidance counselors, teachers were identified and 
contacted to determine their willingness to participate in the study. All 
those contacted agreed to participate, and their classes were selected at ran- 
dom for the two treatment and the no-treatment groups. Since students were 
assigned at random by a computer to these required classes, random assignment 
to treatment was assumed. To further check this assumption, the class sched- 
ules were carefully checked, and the counselors, teachers, and principal were 
consulted before assignments were made. 
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Table 2 



Relationship betwe«n Questionnaire Items 
an«l Evaluative Criteria 



Criteria 

Understanding and recollection of 
occupational code 



Number of considered occupations 

Satisfaction with vocational counseling 
experience 

Satisfaction and certainty about 
vocational plans 

Time spent thinking about occupational future 

Specificity of vocational motivations 

Need for occupational and educational 
information 

Need for information about oneself 
Information -Seeking 



Questionnaire 

SOF* 
VGQl 
VGQ2^ 

VGQl 
VGQ2 

SOF 

VGQl 

VGQ2 
VGQ3 
VGQl 

VGQl 
VGQ2 



^SOF 

Wgqi 

<^VGQ2 
'^VGQa 



Student Opinion Fovm. 

Vocational Guidance Questionnaire 1. 

Vocational Guidance QuesMonnaire 2, 

Vocational Guidance Questionnaire 3. 



Item 

Part II 
5 

Part II 
4 

4 
2 

1-7 & 10-12 
8-9 

6A, G, H, 
I, and J 

3 

7 

6C, D, E, 
and F 

6B 

A- 1 



Source 



Zener & Schneulle (1972) 



Au thor 

Zener & Schneulle (1972) 



II 



Author 

Zener & Schneulle (1972) 



II 



and Krumboltz & Schroeder 
(1965) 



14 



10 



ERIC 



Tabic 3 



Scale Used for Describing Similarity between SDS 
Suninary Code and any other three- letter Coda" 



Verbal Description ouo 

^ Chance Expectancy Index 



1st letter of SDS suumary code is not included 

in other (e.g. RIC, CES) ^5qq 

1st letter of SDS summary code matches any 

letter in the other code (e.g. RIC, CRE) .500 

1st and 2nd letters of SDS summary code match 
any two letters in the other code (e.g. RIC, 

^^^^ .250 

1st letter of SDS summary code matches first 

letter of other code (e.g. RIC, REA) .i67 

All three letters of SDS suranary code match 
letters of other code in any order (e.g. RIG, 
ICR) 



1st and 2nd letters of SDS summary code match 
^st^and 2nd letters of other code (e.g. RIC, 

Letters and order exactly the same 



.125 4 

.033 5 
.008 6 



^Taken from Zener and Schneulle (1972, p. 26). 
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Those junior high school teachers who were to teach an "orientation" 
lesson prior to administering the O-S or SDS were given a lesson plan (see 
Appendixes B and C and the 0-S/SDS materials two weeks in advance to prepare 
themselves. Consultations were held with them one week later to answer any 
questions and to insure their readiness. On the first day, the orientation 
lesson was given and students were introduced to the O-S or SDS. Students 

Once"t^e 0%5sns°"'^'°' °i completed it on the third day. 

Once the 0-S/SDS was completed, it was picked up and one-half of the classes 
w^e given the SOF (see Figure 1). The other half did not complete the SOF or 
the next questionnaire, the VGQl. The one-half who had completed the SOF also 
completed the VGQl and the VPI. A. Figure 1 indicates, one'half of the 
claoses assigned to the no-treatment condition completed the VGQl; the other 
half was not contacted. 



^h.^ !r senior high school classes, the same pattern was followed except 
O-S or sSq f? ^ f day orientation. All treatment classes started on the 
O-S or SDS the first day and completed it on the second. One-half of these 
comp eted the SOF, the VGQl, and then the VPI. The students in the ot^er 

^n^h ?f f "^"^ '^^^'^ ^^^^^ activities once finished, 

une-half of the np-treatment classes completed the VGQl. 

The purpose in having only one-half of the students complete the ques- 
tionnaire instruments (see Figure 1) was to provide a control for the possi- 
bility that the questionnaires influenced the outcomes of the study If all 
the students completed the questionnaires, it would be impossible to determine 
• Sk? 1 '^°"^°^'"ded" the results. This "questionnaire control" made it Z- 
sible later to test the effect of the questionnaires by themselves. 

The students in the treatment classes at both junior and senior high 
school levels were given their 0-S/SDS booklets on the day following their 
having completed them. ^ i-nei-r 

The students in the treatment groups were told that; a new vocational guid- 
ance Instrument was being tried out. All directions were printed in the book- 
lets, but students were told to ask for assistance .f they had any questions 
IIslII l." V'^^r^ff- °J -«^«tant was present with'the teachers to 
assist In coordinating and answering any questions. Students in the no- 
treatment classes were told that their cooperation was needed in order that 
materials could be developed which would help them in their vocational pUn- 

rhp vr^^r'''''?'!^^ ^^"'^ teachers administered the VGQ2 

l^l '^'^ had taken it previously the first 

steps through the calculation of the code were completed). 

Statistical Analy ses 

As was indicated in the introduction to this report, the O-S student.' 

foMTp"" T ''''''''' '° ^° -n rol studea per- 

lormance on the ten ciiteria described. These were the a nrinrirr^T ^ ^ 

and they were analyzed using a t test. In thosHas wL^T?^ coZVAZl' 

were nonorthogona 1 . Dunn's procedure was followed as recommenced byTrk 
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(1968). Other effects were of Interest. These included socioeconu. status 
race sex, school level (Junior/senior high school), setting (rural, suburban, 
urban), questionnaite control, and their interaction with the treacment 
effects. These were the a posterio ri comparisons. It was assumed that the 
effects which would be most influential, however, were sex, school level and 
treatment. To test this assumption, an analysis of variance (ANOVA) was 'com- 
puted for a 'full model" (all effects and their interactions) and a "simple 
model (sex, level, and treatment); these two models were compared using an F 
statistic: 

F « ^l^err or (Simple Model) 
^^error (Full Model) 

If there w.is no significant difference between the two models (p < .05) the 
simple model was adopted. Where effects were found which required a multiple 
comparison test, Duncan's Multiple Range Test (MRT) was used (see Kirk 1968) 
In all analyses the .05 level of significance was adopted. 
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RESULTS AND DISCUSSION 



The full and simple models of ANOVA were computed and evaluated for each 
dependent variable. There was no significant difference found between the 
models. Justifying the use of the simple model. The outcomes for each of the 
ten criteria are examined in this section. For each criterion the results for 
the a priori and a posteriori comparisons are given, in that order, and then 
discussed. 

Proportion of Nont raditional Occupations 

Three areas were examined in this part of the study; (a) the proportion 
of nontraditional occupations suggested to students by the 0-S or SDS, and 
the proportion of nontraditional occupations students said they were interested 
in (b) immediately following the experience and (c) three weeks later. 

Proportion suggested to students . The mean proportion of nontraditional 
occupations suggested by the 0-S was .28, and .20 was suggested by the SDS, which 
was statistically significant ( t, = 2.15). The ANOVA showed significant effects 
for sex (£ < .0001) and sex by treatment interaction (£ < .004) . Treatment 
effects, which were significant (£ < .03), are not discussed here as they were 
analyzed using the t^ test. Table 4 shows that the difference between the 0-S 
and SDS is accounted for by the girls. The 0-S suggested more nontraditional 
occupations to the girls; there were no real differences between the 0-S and 
SDS with respect to boys. 

Table 4 



Proportion of Nontraditional Occupations Suggested by 
the 0-S and SDS for Boys and Girls 



Group 


n 


Proportion 


Boys - 0-S 


^ 46 


.08 


SDS 


58 


.10 


Girls - 0-S 


54 


.44 


SDS 


58 


.29 



Immediat ely following . The occupations students listed on VGQl were ana- 
lyzed and t tests were computed for the means (0-S/SDS; 0-S/control) . Since 
two nonorthogonal comparisons were being made, Dunn's procedure requires divid- 
ing the alpha level: .05/2 = .025. Thus, the £ level for these comparisons 
had to be less than .025. The difference between the 0-S and SDS means ( 32 
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and .18, reapectively) was statistically significant (t = 2.41). The 0-S/ 
control comparison was nonsignificant (means were .32 and .24, respectively). 
Whei. treatment effects of the ANOVA (p <.02) were analyzed, however, using 
Duncan's MRT , the 0-S students were shown to have listed a significantly 
greater proportion of nontraditional occupations than students in either the 
SDS or 0-S groups. 

The ANOVA also revealed a strong sex effect (£ < .0001). When averaged 
across the three groups, the girls listed .41 nontraditional occupations and 
boys listed .04. It should be noted here that the majority of occupations are 
nontraditional for females. Using the criteria for nontraditional used in 
this study, the occupations listed in the 0-S booklet were analyzed. These 
523 occupations account for about 90 percent of the occupations which exist 
and are a representative sample. Of these occupations, 70 percent are non- 
traditional for females, 15 percent for males, and 15 percent are neutral. 

Three weeks later. Using Dunn's procedure where <X= .025, a statistically 
significant difference was found between the 0-S and SDS means (.26 vs. .21 
t =1.54) but not between the 0-S and control groups (.26 and .24, respect-* 
ively). The ANOVA revealed that the girls listed significantly more (p < 
.0001) nontraditional occupations (.42) than the boys (.04), when averaeed 
across groups. 

To summarize the results, then, the C -S consistently broadened the career 
options of the girls when compared with the SDS. It suggested a greater pro- 
portion of nontraditional occupations among girls, and they were considering a 
greater proportion immediately following and three weeks after the experience. 

These findings are encouraging and support earlier studies (Cooper, 1976; 
Lawler, 1977) in which occupational card sorts have been shown to broaden the' 
career options of women better than more traditional vocational exploratory 
instruments. That these effects appear to affect primarily females in the 0-S 
treatment group (see Table 4) is rather disappointing. Since so few occupa- 
tions are nontraditional" for males and those which are have such strong sex 
role overtones, it is probably unrealistic to think that a vocational counsel- 
ing experience should be influential. 

The strongest and most consistent differences were found between the 0-S 
and SDS rather than the 0-S and control groups. This suggests that the 0-S's 
effect of suggesting a large proportion of nontraditional occupations may need 
to be strengthened by some type of follow-up exercise in order that a greater 
proportion be listed as being of interest. 

Recall and Understanding of Code 

The^three-letter occupational code is a critical element in the two treat- 
ments, students recall and understanding of it were assessed in three ways 
First, they were asked to write down the three letters of their code. A com- 

?he 0°S nr%n? ?''"'r" '^'^^^^^ «^he one they obtained on 

the 0-S or SDS using the "index of similarity" described earlier. Secondly 
thev were asked to write down the names for the letters they had recalled 
One point was given for each letter correctly named. Third, they were asked 
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to match the Holland personality types with their respective occupations (e.g., 
see VGQ3 item 4) and to complete a multiple-choice item assessing their under- 
standing of Holland* s theory. Assessments were made immediately following the 
experience and three weeks later. 

Immediately followinj^ . No significant differences were found between the 
0-S (X = 4.43) and SDS (X » 4.45) students in their recollection of the code. 
None of the ANOVA effects was significant. There were significant differences 
between students' ability to name the letters; the 0-S students' mean was 1.34, 
and the mean for the SDS students was .53 (t == 3.73). The ANOVA was signifi- 
cant for treatment effects only (£ < .0004). 

No significant differences were found in the a priori comparisons (0-S/ 
SDS, 0-S/control) for the personality type-occupation matching item. The 
ANOVA showed a significant level effect <£ < .04); junior high students' per- 
formance was better (3.04) than senior high students' (2.56). 

Three weeks later . There was no significant difference between the recall 
of codes by 0-S students (1.59) and SDS students (1.46). The ANOVA was non- 
significant. Again, the 0-S students' ability to name the letters in their 
code (.56) was superior to that of those who took the SDS (.30; t^ = 2.54). 
At'OVA was significant for treatment effects only (£ < .01). 

Two t. tests for the personality-occupation matching item were run 
.025), and a significant difference was found between means (t^ = 2.36), favor- 
ing the 0-S group (2.56) over the SDS group (2.20). The 0-S/control compari- 
son was nonsignificant. In addition to the significant treatment effects (£ < 
.03), a level by treatment interaction effect was significant (£ < .0001). 
There were no substantial differences among the senior high 0-S, SDS, and con- 
trol groups (2.68, 2.34, 2.29), but there were at the Junior high level (2.32, 
1.94, 3.09) . 



The multiple-choice item designed to further assess students' understand- 
ing of Holland's theory was analyzed. Two t tests were run (oc= .025), and a 
significant difference (_t « 2.72) was found between the 0-S (1.68) and control 
(1.50) groups. Treatmeht effect was significant for the ANOVA (£ < .009), and 
Duncan's MRT revealed significant differences between the two treatment groups 
and the control group (SDS = 1.63). 

To summarize, there was no difference between the students in the two 
treatment groups in their ability to recall their three-letter code, but the 
0-S students were much better able to give their code letters the correct 
name. The treatment groups' ability to match occupations with personality 
types was no different from that of the controls at the beginning, but three 
weeks later the results favored the 0-S group. 

The ability of the students to recall their code was initially good but 
fell off rapidly over the three-week period. The ability of students to name 
the letters of their codes was rather poor initially; this was particularly 
true for the SDS. The difference in performance between the 0-S and SDS may 
be accounted for by the 0-S's containing a brief description of the six 
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personality types. The 0-S also contains a brief description of Holland's 
flTllL H?ff'^^'' together with descriptions of the types, probably accounts 
for the differences found at the three-week assessment point where 0-S stu- 
SDS r T^ *r'*fr understanding of their test results than those in the 
SDS group. It should also be mentioned that the results regarding the match- 
ing ot occupations with personality type conflict with thosfof an earUer 

bl'L^thTn^h^'S^^rol^gri!;!^ ""^ ^^^^^"^^ ^ 

Number of Occupations 

hnr^.o''^ °f P^"*P°"« the 0-S and SDS is to expand the occupational 

ments. First, the occupations suggested to students were counted. With the 
0-S. students were asked to "put a check in the box next to each one that 
in erests you." Users of the SDS were asked to write down "some o^t^e occu- 
pations whose summary code resembles yours." Secondly, students were asked to 
list those occupations they were considering at the time. 

tions ^3d'hp '° srndenrs . It was predicted that a greater number of occupa- 
tlons would be suggested to students by the 0-S than bv the <?nq -nH 

"."'Jrini- ^'^^ -^"""^ -cupat ons! If^^TllAl 

«rvd the SDS suggested 10.83. The ANOVA Itvdlc.ted slgrvlflcarvt ef fectl forthe 

t :r s'ii7*? <^<-<'*>--" -'"^"^""^ ™" suggested "r 

students (17.59) than senior high students (14.09): (b) treatment fn ^ nnm?. 
c sex by level (^ < .045)-the results are Indicated belonn"abfe 5 an" ' 
(d) sex by treatment by level (^ < .03), v*lch was not further analyzed 'since 



Table 5 

Number of Occupations Suggested to Students: Sex by Level 



Sex 



Junior 



School level 



Senior 



Male 



Feaia I e 



19.56 

(n = 23) 

15.85 
(n = 26) 



13.24 

(n = 83) 

14.91 

(n = 86) 



-ans^ffF^f^^fy^^ ^^"-ences found when 

vealed significant lev 1 effects p< 000l'T T"\Tt' ' '''^ ^""^ 
occupations (5.40 vs 3 96) I.i.nff;? ' ^"u °f ^^^^ students listed more 
tlon .as Identified in ; 007/ ' f'^V^^"""'^ ff^ ^^^^1 by treatment interar 

uei.Litiea ^£ < .J07), but since cell numbers were so «?man fr^r- tu 
lunior high level, further analyses were nut pursued. '''^ 
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Three weeks later . Here, too, a priori comparisons were nonsignificant. 
For the ANOVA, sex and level were significant (£ < .002 and .0001, respect- 
ively). Girls listed more than boys (4.39 vs. 3.74), and j^uflior high students 
listed more than those in high school (4.89 vs. 3.66). 

To summarize, nearly twice as many occupations were suggested to 0-S stu- 
dents as to ?DS students. However, there were no significant differences be- 
tween these treatment groups and the control group in the number of occupa- 
tions they were considering immediately following the treatment or three weeks 
later. This is in contrast to the Zener and Schneulle (1972) study, where 
differences were significant and in favor of the SDS and VP! groups. 

Satisfaction with Vocational Counseling; 
Experience 

Items 3 and 6 of the SOF were reverse scored, and then the responses of 
all 12 items were summed and divided by 12 to produce a mean satisfaction 
score for each student taking the 0-S or SDS. A t. test between the means for 
the two groups (2.20 and 2.28, respectively) was calculated. The difference 
was nonsignificant. 'An ANOVA was computed, and sex was significant (£ < .0004). 
Males (2.41) indicated greater satisfaction than females (2.07). 

The student ratings of the two treatment experiences, generally, were 
surprisingly low. The results for each item are reported in Table 6. In pre- 
vious studies with the 0-S, the ratings were moderately positive. In one 
study (Jones & DeVault, 1979), tenth-graders' mean rating was 3.38 overall for 
the 0-S (n = 47) and 3.28 ( n = 48) for the SDS. In another study (Jones, in 
press-a). Upward Bouri students (n = 44) gave the 0-S a mean rating of 3.27; a 
small sample of suburban high school students (n = 14) gave it a mean rating 
of 3.28. Finally, Zener and Schneulle 's (1972) data indicated that high 
school students gave the SDS a mean rating of 3.11 (estimated n = approximately 
600). Thus, the results from this study are a surprise and a disappointment. 

In examining the individual items in Table 6, only three items received a 
mean rating greater than 3--items 3, 6, and 11. This was true for both the 0-S 
and SDS. These items, taken together, suggest that many found the treatments 
confusing, without merit, and a waste of time. The conflict between these 
ratings and previous ones is puzzling. It would have been helpful to have in- 
cluded a question about the students' interest or willingness to participate, 
as some may have resented the intrusion into their classrooms. 

Vocational Information Seekinj^ 

Three weeks following the treatments, students were asked (VGQ2) to indi- 
cate if they had sought out educational or occupational information during 
this three-week period. Comparisons were made for variety of information 
sought. There were no significant differences between the 0-S (14.61) and the 
SDS (14.86) or control (14.86) groups. ANOVA revealed the following effects- 
sex (£ c .005; males - 14.99, females = 14.60), setting (£ < .0001; rural = 
14.17, urban = 14.84, suburban = 15.09), as well as sex by treatment (p < .01) 
and level by treatment (£ < .003) interaction effects (differences were so' 
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Table 6 



Means and Standard Deviations for Student Opinion Form Items 





Item 


0 


ca 


SDS 


b 


Overall^ 




M 


GD 


M 


SD 


M 


SD 


1. 


Some of the occupations I found seem reasonable to me. 


1.80 


.49 


2.17 


.99 


2 m 


.82 


2. 


I have some clearer ideas about possible occupations 










3. 


for myself. 


2.02 


.85 


2.03 


.83 


2.02 




I did not learn anything about occupations through 










4. 


this experience* 


3.98 


.85 


3.68 


1.05 


3.81 


.98 


I have some clearer ideas about unsuitable 








5. 


occupations for myself. 


2.18 


.77 


2.46 


.92 


2.34 


R7 


I learned some things about myself through this 










counseling experience. 


2.40 


.89 


2.31 


.89 


2.35 


.89 


6. 


This vocational exploration experience was not a 












7. 


good use of my time. 


3.87 


.88 


4.01 


.84 


3.95 


.86 


I would recoTnnend this vocational experience to a 












8. 


friend. 


2.33 


1.00 


2,10 


.80 


2.20 


.89 


As a result of this experience I have found other 












9. 


occupations for n^self I had not thought of before 


2.43 


.89 


2.43 


1.03 


2.43 


.97 


I now have a clearer idea of what I am looking for An 












10. 


an occupation. 


2.17 


.89 


2.42 


.97 


2.31 


.94 


This vocational experience encourages me to find out 










11. 


information about occupations. 


2.38 


.79 


2.10 


.78 


2.22 


.79 


Tlie results of this experience are confusing or 












12. 


unsatisfactory. 


3.70 


1.10 


3.60 


.95 


3.64 


1.02 


My three- letter, summary (occupational) code seems 










reasonable for me. 


2.19 


.90 


2.72 


1.18 


2.48 


1.09 



Note: None of the items are reverse scored in the table. 



*^n = 55. 
bn = 71. 
= 126. 
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small as to be not worth mentionlag). The results for fregunacv o f mformar^nn 
■rr'^AMnw! treatment effects were nonsignificant. Only level 

iLTt ? t ''^''^^'^^^'y significant (jg, < .04); senior high students 
hUlf Students (7'™26^ frequently on the average (9.09 times) than Junior 

This was a disappointing, although not a totally unexpected, outcome. 
Zener and bchneulle (1972) found the same results when evaluating the sSs 
One wou cl think, though, if students checked 19 or more occupatiL L which 

Hon seir '^'^ h-*^ stimulated more informa- 

tion seeking. Perhaps they needed further encouragement and help. 

Satisfaction and Certainty about 
Vocational Plans 

b« mnll r^^^f!^^'''^ students who participated in the treatments would 

be more satisfied and certain about their vocational plans. However the re- 

the":tud:n ri th T; '"^"^^^^^ ^"^^^^ ^^^^ sUficant (^ <'.52 . but 

0-S 77) and SDS%r7 r ^"^'"'^^ ^'^'^^ ^^^^ i" the 

^ ^ U.//; and SDii (2.75) groups, according to Duncan's MRT. 

the f^^d^n of course, are disappointing. They are also at odds with 

SDS or vi?' '° Schneulle (1972). Students who took the 

SDS or VPI were more positive in this respect than those in the control group. 

Time Spent Thinking about 
Occupational Future 

leveWo i^55§ff'Trr'?"' significant effects for 

Level (£ < .0001) and the level by treatment interaction (p < .03) were found 
for the a posteriori comparisons. Junior high students spent less time (3 12) 
t unking about their occupational future than those in high school 3 54) 

In W r^rsis" ^^''^ ""^"^ ^'i^ students, appir- 

Z^e tLV the^^-f o^co^n^r^l^ro^^r " ^^"^^^^ ''^'^ ^ 

Table 7 

Time Spent Thinking about Occupational Future: 
Level by Treatment 



r^, Sch ool Level 

V/ L J lip 



0-S 

SDS 

Control 



n 


Junior 




n 


Senior 


50 


3.42 




111 


3.58 


73 


2.93 




129 


3.57 


63 


3.33 




142 


3 . VB 
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Spoclfica tlon of Vocational Planning 
Criteria 



^.n^ I J Students were asked to specify those things Impor- 

tant to them In making a vocational choice. It was predicted that the O-S 
students would specify a greater number because they must articulate their 
criteria in sorting the cards. All differences, however, were nonsignificant. 



Need for Information about Onesftl f 



n««d Jnr ?% ^^^^^ atudents who did the O-S or SDS would feel less of a 

^hfrf^ui J« r themselves (Item 6B. VGQl) immediately afterward, 

cant hypothesis; all differences were nonsignifi- 

Need for Occupational and Educational 
Information 

It was predicted that students in the treatment groups would express a 
greater need for occupational and educational information. ^Tl p^iorrcL 

ilfl^n^ H?ff^ ' ^''V ""'^"^ <^-90>' Ther! was no "g- 

nif leant difference between the O-S and SDS (2.07). Only treatment effects 

nil : f;"'''"'K^^ ^ '^^"^ ^-""'^ M^T re"::i':rthat the 

^h^H?^f """k*""'^"" ''^^ 8""P« nonsignificant: but 

the difference between the O-S and control groups was significant. 

Given these differences, one might have expected O-S/control croup dif- 
ferences in information seeking, but, as reported earlier the« w^^e Lne 
IZll ?"^H'^"cni'' ^'^'^^ i« their stu^ ?he ;tu- 

(not tJue Jn ^ "^ed information th'^n controU 

seekine LJ^ %m '^^"^ ^o difference in information 

seeking Again, this suggests the need for some type of follow-up activity to 
capitalize on the increased need for Information stLulated by the 0-" 
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PSYCHOMETRIC CHARACTERISTICS OF THE 0-S 

Three areas were Investigated: (a5 test-retest reliability of the 0-S 
occupational code over a three-week period, (b) concurrent and' construct 
validity of the 0-S code, and (c) the number and seriousness of student errors 
fflixde in calculating the code. Sex and school level (Junior/senior high school) 
differences were examined as appropriate. 

Test-Rctest Reliability 

Rctest reliability was assessed using two different procedures. First, 
the seven-point scale of agreement recommended by Holland (1972) was used to 
compare the 0-S codes of students on the first day with the code they received 
on the 0-S three weeks later. Table 8 indicates the extent of agreement over- 
all , by school level, and by sex. Another way of viewing these data is that 
for 86-89 percent of the students, at least two of the three letters of the 
code on the first administration appeared in the code obtained three weeks 
later. The second approach was to correlate the 0-S raw scores obtained for 
the six Holland types on the first administration with those of the second. 
The Pearson product-moment correlations are Indicated in Table 9. With both 
approaches, scores were corrected for any student errors before the analyses 
were conducted. 

To summarize, the 0-S codes were moderately stable over a three-week 
period. The codes of the senior high school students were generally more 
stable than those in junior high. Sex differences were quite apparent; the 
codes of the female students were clearly more stable than those of males. 

Validity; Construct and Concurrent 

The construct validity of the 0-S occupational code was investigated 
first. According to Holland's (1973) theory, the six occupational types are 
ordered according to a hexagon in which distances between types are Inversely 
proportional to the size of the correlations between them. Thus, to examine 
the construct validity, the students' raw scores for the six types were inter- 
correlated to see if these predicted relationships were supported by the data 
As Figure 2 indicates, the majority of the Intercorrelatlons were in the pre- 
dicted direction at the predicted level of strength. These intercorrelatlons 
were also compared with the intercorrelatlons of the students' VPI raw scores 
A visual inspection reveals that they conform to the hexagonal model about 
equally well. Thus, while the intercorrelatlons of the 0-S do not perfectly 
match the hexagonal model, they do approximate it fairly well, and as well as 
the VPI intercorrelatlons do. 

To examine the concurrent validity of the 0-S, the seven-point index of 
similarity was used to compare each student's 0-S occupational codte with the 
one obtained from the VPI. The results are reported in Table 10. A moderate 

ol"nH°L A comparison between the 

0-S and SDS was also made. The degree of similarity between the SDS and VPI 
occupational codes was compared with that between the 0-S and VPI The dif- 
ferences at the senior and junior high school levels were evaluated and found 
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Tablo 8 

Proportion of Students at Each Level of Similarity 
between First and Second Administration of 0-S 
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Degree of Agreement 



School Level 



Sex 



Overall Junior Senior Male Female 



6 Are they exactly alike? 

5 Are the first two letters 
in the same order? 

4 The first three letters arc 
the same, but are they out 
of order? 

3 Is the first letter in each 
code the same? 

2 Do the first two letters of 
one code match any two letters 
in the other? 

1 Does the first letter of either 
code match any letter in the 
other code? 

0 The first letter of one code is 
not included in the other code. 



.19 
.13 

.17 
.16 

.23 

.08 

.04 

107 



.14 
.09 

.09 
.23 

.32 

.14 

,00 
22 



.20 



.14 



.19 



.14 



.21 



.07 



.12 



.15 



.12 



.15 



.33 



.08 



.25 



.11 



.22 



.16 



.14 



.09 



.05 .06 .02 

85 52 55 
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Table 9 



Pearson Correlations of 0-S Raw Scores for 
Two Administrations, Three Weeks Apart 



School Level Sex 

IVpc Overall Junior Senior Male Fettmle 



R 


62 


52 


65 


59 


50 


I 


58 


60 


58 


52 


67 


A 


54 


52 


51 


48 


56 


S 


63 


41 


68 


33 


79 


E 


66 


68 


66 


61 


69 


C 


73 


57 


74 


44 


82 




n = 107 


22 


85 


52 


55 



Note: Decimals omitted. 



nonsignificant at the .05 level using a two-tailed test (_t values were -1.16 
and -.59, respectively). 

This latter finding of no significant difference between the concurrent 
validity of the SDS and 0-S is particularly encouraging, since previous 
attempts to develop alternative methods of calculating a Holland occupational 
code have required complex weighting systems (Campbell & Holland, 1972; 
Franz, 1972). This finding is buttressed by an earlier study (Jones & De 
Vault, 1979) wtiich also found no difference. 

The overall findings with respect to validity, then, were generally quite 
encouraging. The correlations among the 0-S raw scores were generally in the 
direction and strength predicted by the Holland hexagonal model, and these 
correlations fit the hexagon as well as the results of the VPI, Holland's 
(1973) definitive measure of the six types. A moderate degree of similarity 
was found between the 0-S and VPI codes, and no difference was found between 
the concurrent validity of the 0-S and Holland's SDS. 
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Figure 2 

Correlation Matrix Among and VPI Scores, Overall 




: 0-S correlations (n = 121) are outside parentheses, VPI correlations (n = 13 
are inside. — 
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Table 10 

Proportion of Students at Each Level of Similarity 
between the 0-S and VP I Occupational Code 



Degree of Agreement 



Proportion 



6 Are they exactly alike? 

5 Are the first two letters in the same order? 

4 The first three letters are the same, but are they 
out of order? 

3 Is the first letter in each code the same? 

2 Do the first two letters of one code match any two 
letters in the other? 

1 Does the first letter of either code n^tch any 
letter in the other code? 

0 The first letter of one code is not included in 
the other code. 



.04 
.15 

.21 
.21 

.13 

.21 

.06 



Note: n « 53. 



Errors in Calculating the Cndt> 



Since the self -administered mode of the 0-S uaq mqoH 
errors students made in the calculatinn of !k / ' """"^^ °^ 

terest. Table irreports the e^tPn^ f occupational code was of in- 

school level. S nee the "^^ber of tvnf T'"' ^'"'^"'^ by 

exceeded expectationsl%eTo'ranMS^? lUT/cZll f L^au^r 

iTrl ZllZ bl-choo^rlnts^ttLI ^"rT^br ^---u%LnTfoi^the!I^^^ufei;s 
"suburban- school mad^no type 3 er^ort ! ^ ^he 

schools did. The differencl hP^ u Percent of those in the "urban" 

is probably-accounted Lrb" the c^'ndi' loL'^uT^ 'iT'' 

tered. Unfortunately the teacher ^n ^ i a ''^^'^ ^'^ adminis- 

mamtain discipline in har classroom %'t°H t '° ^« ""^^^^ ^o 
ruly, and this^ppears "o\:l:rf^^^^^^^^^^ noisy and un- 

occu^l'Tol^^^^^^^^^ the O-S and users examine 

be misleading would be the type 3 error ibout ' °' ^^^^^ ""^^ 

category. An examination of'?U e coderof thes U ^tu'd^nt 'T. ^''^ 

cnese ii students revealed that nine 
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Proportion of Students Making Errors Overall and at 
Junior and Senior High School Levels 



^ c V School Level 
Extent of Errors Overall J^I^ 



3 Code contains at least one incorrect 
letter « 

2 Correct letters, but not in proper 

order. q2 



.09 .14 .07 

.00 .04 



1 Error in computation, but correct 
code. 




.16 




.22 


.13 


0 No errors, correct code. 




.73 




.64 


.76 


ti = 




121 




36 


85 


Table 12 












Proportion of Errors Made by Urban and Suburban Junior High School 


Sti.dents 


Extent of Errors 


Urban 
A 


Schools 
B 


Suburban School 


3 Code contains at least one incorrect 
letter . 


.38 




.14 




.00 


2 Correct letters, but not in proper 
order. 


.00 




.00 




.00 


1 Error in computation, but correct 
code . 


.12 




.29 




.21 


0 No errors, correct code. 


,50 




.57 




.78 


n = 


8 




14 




14 
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(82 p jnt) contained two of the three correct letters and two (18 percent) 
contained one. In an earlier study (Jones & DeVault, 1979) done with high 
school students, only four percent made the type 3 error. 

While one would hope for no errors in calculating the code, this is 
probably not realistic. If the self -administered mode of the 0-S is viewed 
a vocational counseling simulation instead of a "teat," one may argue, as 
HpUand (1975) has for the SDS, that the 0-S error rate should be compared 
with the error rate of the average counselor. Nevertheless, it would seem 
wise to take a few minijites to check students' scoring, especially those who 
are young or have limited reading and computational skills. The poorer per- 
formance of students in school A also confirms the conmon sense conclusion 
that test administration conditions may play a potent role in students' per- 
formance . 
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SUMMARY 



'V' T l^"""^^ ^^''''^^ purp^>M. First, the effects of an occupa- 

tional card sort technique on the thought^ and activities of junior and senior 
high school students were studied. The principal qu/stion was, "Do positive 
vocational counseling effects result from/students taking the Occu-Sort?" The 
second purpose was to evaluate the reliability and Validity of the three-letter 
occupational code obtained from the 0-S; that Is, /is the Occu-Sort occupational 
code sufficiently reliable and valid to asVlst st/dents in their vocational ex- 
ploration and planning?" The results are ^uiaaarlzed below. 

Vocational Counseling Effects 

1. When compared with the SDS , the 0-S suggested a greater proportion of 
nontraditlonal occupations to female students. The 0-S females also 
listed a greater proportion when asked later what occupations they 
were considering. Male students were unaffected. 

2. There was nc difference between the 0-S and SDS students in their 
ability to recall their three-letter code, but the 0-S students could 
name the letters better and evidenced a better understanding of Hol- 
land's theory. ' ^ 

3. The 0-S suggested a greater number of occupations to students than 
the SDS, but there were no differences between the treatment and con- 
trol groups when they were asked to list the occupations they were 
considering. This latter finding conflicts with previous studies. 

i:. There was no significant difference between the student satisfaction 
ratings of the two treatments. The overall ratings were moderately 
negative; this latter finding conflicts with previous studies. 

5. There was no difference among the 0-S, SDS, and control groups In the 
variety or frequency with which the students sought out occupational 
or educational information, 

6. Control group students were slightly more satisfied and certain about 
their vocational plans than those In the treatment groups. This un- 
anticipated finding Is at odds with previous studies. 

7. There was some evidence among junior high school students that SDS 

IZtTnl n^T' '''^"^^"^ ^^^^^ occupational future 

ms Variable"' students. Overall, the O-S did not affect 

8. There was no difference roong the groups In their ability to specif, 
vocational planning criteria. speciry 

^' luZLT" no difference In the students' need for Information about 
themselves when group means were compared. 
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10 « Students who took the 0-S expressed a greater Interest in occupa- 
tional and educational information than students in the control 
group. There was no differ^pce between the SDS and control groups. 

Psychometric Characteristics 

1. 0-S three-letter occupational codes were moderately stable over a 
three -week period, 

2. The results provided moderately positive evidence for the construct 
validity of the 0-S three-letter code. When compared with the VPI, 
the 0-S results matched the hexagonal model equally well, 

3. There was no significant difference between the concurrent validity 
of the 0-S and SDS. 

4. While the number of errors in calculating the 0-S three-letter code 
was higher than had been observed in an earlier study, further anal- 
ysis suggested that the conditions under which the 0-S was adminis- 
tered were the cause. Overall, the number of errors was low. 
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APPENDIX A 

EXPLANATION FOR DROPPING THE RURAL JUNIOR 
HIGH SCHOOL STUDENTS FROM THE STUDY 

The students in the rural Junior high school were unable to complete 
either the O-S or SDS in the allotted time. The tasks were obviously diffi- 
cult for them, and it was decided to discontinue the study with them. 

To better understand the reasons for the students' difficulty, several 
characteristics of the students in this rural, poor area .may help. Socio- 
economic status (SES) data were not collected for these specific students, 
but they are from the sdltie coranunity as those students in the rural high 
school used in this study. Table 1 showed the SES data for them. Since 
these high school students were in the higher grades (above the dropout age), 
it is likely that when extrapolating to the lower grades one might estimate 
the proportion in the lower 1/3 since they are more likely to drop out. 
Regardless, the proportion of those in the lower 1/3 Is very large. Re- 
flecting this, 41 percent of the eighth-graders receive a free lunch, and 
7 percent receive a reduced-price lunch. Seventy-nine percent of the eighth- 
graders were reading below grade level. Thus, it seems reasonable to assume 
that the students' difficulty with the tre.ii.menLa is a reflection of their 
disadvantaged backgrounds. 
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APPENDIX B 
OCCU-SORT INTRODUCTION LESSON PLAN 

Objectives 

Tomorrow you will be involved in an activity called the Occu-Sort. ThiB 
is an occupational card sorting exercise designed to introduce you to new 
occupations and start you thinking about choosing an occupation. 

Instructions and Examples 

Each of you will be given a set of 60 cards with a different occupation 
written on each card. You will be able to see the cards later in the hour. 
These cards are to be sorted into three piles; 
(write descriptions below on board) 

Would Not Choose Uncertain Might Choose 

Those occupations Those occupations you Tliose occupations 

which do not appeal are indifferent about that appeal to you, 

to you, or in question about. 

After the cards are sorted into the three piles, each pile must be looked at 
separately and sorted into even smaller piles according to the different 
reasons you have used to place them in the original three piles. 
For example: 

A student sorts the Would Not Choose pile into several small piles. 
One of these piles contiins the cards: 

(write on board) Occupation 

1* line repairer 

2, heavy truck driver 

3, sales route driver 

The student's reasons i'or grouping these are: 

(write on board) Reasons 



1, they are outdoor occupations 

2, involve travel 

3, physical work 

4, not very interesting 



The student then sorts the Might Choose pile into several smaller piles 
according to the reasons why they might be chosen. One of the student's 
small piles contains the cards: 
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(write on board) Occupation 

1. accountant 
2* ' treasurer 
3. bookkeeper 

The student's reasons for grouping these are- 
(write on board) Reasons 



1. they involve working with math, 
my favorite subject 
"•i2, they involve a lot of respon- 
sibility 
3. pay is good 



Student's Examples and Discuss! 



on 



severa 



Now, I would like for you to get out a sheet of paper At the ton iw 

al occupations which you feel vou would nn^ nv,r^ ^ * ^* ^^^^ 

. I ^ n J ^ jr ^ -s-ccj. yuu wouia not choose for vouraAif TTrt^^*, 

Instructions Call on several students to volunteer their Would Not Choose 
.^.e t^^cher ^ ^Z^^^.J^^ 

-;£;:;i;d\rpL°r:r:o-^^ 

for considering these, and please he specific, reasons 

Again, call on several students to volunteer their 
Might Choose choices and reasons why. Also write 

InllluT ^"^^^ reasons. Suggest other 

possible reasons, if any, for discussion. 

Other Possible Reasons for 
Would Not Choose 

Too little pay 

More than 40 hr/w. or night work 

College education necessary 

Too much travel involved 

Having a family impractical with job 

Job would not allow for much leisure time 

Not enough variety in job 

Not . enough prestige in job 

Too much direct supervision 

Not many positions available on current job market 

Involves outdoor work / 
Involves indoor work 

41 
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Involves hazardous work 
Involves special talents 
Not enough job security 
Jlotx^ough chance for advancement in Job 
Not enough interest In job 
Not enough leadership In Job 

Other Possible Reasons for ^ 
Might Choose 

Pay good 
Hours good 

No inore than high school education needed for Job 

Travel Involved 

Job would allow for family 

Job would allow for leisure time 

Prestige high 

Variety in. Job 

Occupation involved In helping others 

Independence In Job 

Positions available on Job market 

Involves outdoor work 

Involves indoor work 

Involves a special talent I have 

Excellent chance for advancement 

Interesting 

■\ ^ 

Last 15 minutes of period, hand out 
Occu-Sort cards for students to see, 

I want you to have a chance to see the cards and become familiar with 
them before you sort them tomorrow. Look at the occupation on the front of 
the card and the description of the occupation on the back of the card. 
When you finish looking at all the cards, bundle them up and leave them on 
your desk. 

Thank you 
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APPENDIX C 

SELF-DIREC'IED SEARCH TEACHER INSTRUCTION GUIDE 



Objectives 



Search i ' J^T^ ^^^'^''^ Self-Directed 

nr^Mn.^ ^ " Occupational search designed to introduce you to new 

occupations and start you thinking about choosing an, occupation. 

^Lf vnM ^K? V * ^^^^^ °^ P*P"^» '^i*^® down several occupations 

that you think you may be interested in. (Pause) Now write down several 
reasons why you chose those occupations. iJhy would thirJe a goSd job"or 

¥ 

Teacher: Call on several students to volunteer reasons for deciding 

on (or considering) an occupation. Write these on the board. 
Direct discussion and suggest other reasons to students and 
discuss. 

Reasons for Students to Think About 

1- lhe education required for the job. 

2- Is the pay adequate? 

3- Are these types of jobs available now? 

4- Ain I willing to relocate? Travel? 

5 - Does the job involve working with people? 

data? 

_ . , things? / 

Which of these do you enjoy working with? 

6- Do I have the abilities and talents needed for the job? 

Teacher: Hand out the SDS booklets to allow the students to scan them 
tor five minutes and to ask any questions. 
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APPENDIX D 
STUDENT OPINION FORM 



Name 



Male Female (check one) 



School 



I. Please check (/) the extent to which you agree with the following 

statements : 

1. Some of the occupations 
I found seem reasonable 

to we. I I I I I I 

Strongly Disagree Undecided Agree Strongly 
Disagree Agree 

2. I have some clearer 
ideas about possible 

occupations for myself. | J [ j i j 

Strongly Disagree Undecided Agree Strongly 
Disagree Agree 

3. I did not learn anything 
about occupations through 

this experience. \ | | | j 

Strongly Disagree Undecided Agree Strongly 
Disagree Agree 

4. I have some clearer ideas 
about unsuitable occupa- 
tions for myself. | | _J | j | 

Strongly Disagree Undecided Agree Strongly 
Disagree Agree 

5. I learned some things 
about myself through this 

counseling experience. | j | _j J [ 

Strongly Disagree Undecided Agree Strongly 
Disagree Agree 

6. This vocational explo- 
ration experience was not 

a good use of my time. | L _l J | [ 

Strongly Disagree Undecided Agree Strongly ^ 
Disagree Agree 
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7. I would recommend this 
vocational experience 

to a friend. j j | j j ^ 

Strongly Disagree Undecided Agree Strongly 
Disagree Agree 

8. As a result of this expe- 
rience I have found other 
occupations for myself I 

had not thought of before, j | | | j j 

Strongly Disagree Undecided Agree Strongly 
Disagree Agree 

9. I now have a clearer idea 
of what I am looking for 

in an occupation. | j j j j 

Strongly Disagree Undecided Agree Strongly 
Disagree Agree 

10. This vocational experience 
encourages me to find out 
information about occu- 
pations, j 1^ J I I J 

Strongly Disagree Undecided Agree Strongly 
Disagree Agree 

11. The results of this expe- 
rience are confusing or 

unsatisfactory. j j L_____l | | 

Strongly Disagree Undecided Agree Strongly 
Disagree Agree 

12. My three- letter summary 
(occupational) code seems 

reasonable for me. | [ j j j 

Strongly Disagree Undecided Agree Strongly 
Disagree Agree 

II. Other comments: 

1. My three-letter summary, occupational code was , and the 

name for each of these is ' and 



2. Tlie thing I liked best about this experience was 



3. The thing I disliked was 
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APPENDIX E 
VOCATIONAL GUIDANCE QUESTIONNAIRE H 

Name School 



Sex Race Age Grade 



Read each of the questions carefully and write your answer in the space 
provided. 

!• If you are in high school, please check what type of educational program 
you are in: 

College Preparatory , Vocational Education , General Educa* 

tion , or Other (give title) . 

2. What is your father ^s occupation?^ 



If not working now, what is his usual or former occupation? 
3, What is your mother's occupation? 



If not working, her usual or former occupation? 



4, List all of the occupations you are considering light now. 



5. Beside each of the occupations listed below, write the letter of the 
personality type which is best suited to it. 



Occupations 

Salesman 
^2, Mechanic 

3, Teacher 



_4. Chemist 

5, Musician 

6. Accountant 



Personality Types 

I. investigative 
A. artistic 
S. social 
£• enteirprising 
C, conventional 
R. realistic 



(Please turn over to answer questions on back) 
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6. Check (/) the extent to which you agree with the following statements: 



A. 'file business of choosing an 
occupation is very confusing 
and I don't know where to 
begin. j_ 



1 



1 



1 



i. 



Strongly Agree Neutral Disagree Strongly 
Agree Disagree 



B. I would like to know much 
more about myself before I 
begin choosing an occu- 
pation. 



L 



1 



1 



1 



1 



Strongly Agree Neutral Disagree Strongly 
Agree Disagree 



J 



C, I need to know much more 
about occupational oppor- 
tunities and requirements, L 



1 



1 



1 



Strongly Agree Neutral Disagree Strongly 
Agree Disagree 



J 



D. I would like to know what 
one or two specific occu- 
. pations are all about. 



E. I have some ideas about 
what I'd like to do but I 
need information about the 
training or education 
required* 



F, I need information about 
available training pro- 
grams or colleges I 
might attend* 



L 



1 



1 



1 



1 



Strongly Agree Neutral Disagree Strongly 
Agree Disagree 



I 



1 



1 



1 



Strongly Agree Neutral Disagree Strongly 
Agree Disagree 



1 



1 



Strongly Agree Neutral Disagree Strongly 
Agree Disagree 



J 



G, I need to .talk to a coun- 
selor about my vocational 
choice • 



1 



1 



Sw-ongly Agree Neutral Disagree Strongly 
Agree Disagree 
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H. 



I. 



J. 



I feel I understand the 
kinds of occupations that 
are suitable to my per- 
sonality. 



L 



I feel at ease and com- 
fortable with where I am 
in making a vocational 
choice. 



1 



i 



1 



J 



Strongly Agree Neutral Disagree Strongly 
Agree Disagree 



I have decided on the 
occupation I want to enter 
(for exariple, nurse, elec- 
trical p.ngineer, cook). L 



1 



1 



1 



1 



Strongly Agree Neutral Disagree Strongly 
Agree Disagree 



1 



1 



1 



J 



Strongly Agree Neutral Disagree Strongly 
Agree Disagree 
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APPENDIX F 
VOCATIONAL GUIDANCE QUESTIONNAIRE #2 



Name 



School 



1. Answer the following questions by checking "Yes" or "No." Then, if you 
check 'Yes," answer 'How Many Times?" (You write in the number of times.) 



EXAMPLE: 



Have you applied for a job within the 
past three weeks ? 



A. 



B. 



Within the past three weeks, have you talked 
with other students about yourself and vour 
career opportunities? 

Within the past three weeks, have you talked 
with your parents or relatives about your- 
self and your career opportunities? 

Within the past three weeks, have you read 
or sent for brochures oi: books on jobs or 
occupations? 



D. Withi^ the past three weeks, have you read 
or sent for brochures or catalogs for 
college or training programs? 

E. Within the past three weeks, have you 
visited or made plans to visit colleges, 
training institutions or places of 
employment? 

F. Within the past three weeks, have you 
watched any TV programs, seen exhibits, 
shows, or radio programs with information 
on occupations or colleges? 

G. Within the past three weeks, have you gone 
to see your school counselor either to 
discuss your career opportunities or to 
get information about them? 



Yes 


No 


How Many 
Times? 


y 




2 
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H, Within the paat three we^ks, have you gone 
to the library or to a teacher to get more 
information about jobs or college (or 
training prograins)? 

I. Within the past three weeks, have you 
talked with anyone about his or her job 
to see if it Ls one you would want to do? 



Yes 


No 


How Many 
Times? 















2. List all of the occupations you are considering right now; 



3. During the past three weeks, have you spent more or less time than usual 
thinking about your self and your occupational future? (Place check (✓) 
between lines.) 

I 1 1 I i I 

Much Less About More Much 

Less Time Time The Same Time More Time 

4. Please check (/) the correct answer below: 

V 

People tend to choose occupations where they can be with people 

like themselves. 

b. ^Persons who choose an occupation similar their personality 

type are more likely to be satisfied and successful in it. 

c. Both answers a and b are correct • 

d. ^Neither answer, a or b, is correct. 

If you completed the Self -Directed Search or the Occu-Sort three weeks ago, 
please answer this question: 

^ty three-letter occupational (or summary) code was ; 

the names for each of these letters are 
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APPENDIX G 
VOCATIONAL GUIDANCE QUESTIONNAIRE #3 



. Age_ Race Grade_ 

provided °^ questions below carefully and write your answer in the space 

I. If you are in high school, please check (vO what type of educational 
program you are in: 

College Preparatory , Vocational Education , General 

Education , or Other (give title) 



2. Wliat is your father's occupation? 

If not working now, whe is his usual or former occupation? 

3. What is your mother's occupation? 

If not working, her usual or former occupation? ' 



4. Beside each of the occupations listed below, write the letter of the 
personality type which is best suited to iL: 



Occupations 


Personality Types 


1. Salesman 


I. investigative 


2. Mechanic 


A. artistic 


3. Teacher 


social 


4. Chemist 


E. enterprising 


5. Musician 


C. conventional 


6. Accountant 


R. realistic 



Have you decided on an occupation you want to enter? How certain are 

you? Think about it for a moment Now read the statement 

below, and check (/) the answer that best describes you: 

5. I have decided on the occupation I want to enter (for example, cook, 
nurse, electrical engineer) 

I i \ \ I \ 

Strongly Agree Neutral Disagree Strongly 

Agree Disagree 



51 



4b 



Now that you have checked how decided you are about choosing an occupa- 
tion, hnw do you feel about where you are in making a choice? Concerned? 
Comfortable? 

Read the statement below, and check {/) the answer that best describes yon: 

6. I feel at ease and comfortable with where I am in making a vocational 
choice* 

I 1 — J I I I 

Strongly Agree Neutral Disagree Strongly 
Agree Disagree 

7. Please list below all the things '"hat are important to ^^ou in choosing 
an occupation (for example, some people might write down, "working 

o' tdoors'". Use as many or as few of the lines as you need. 



Thank you for your help, 
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